Each score pertains to the combined test set of the language, without distinguishing individual treebanks and the enhancement types they annotate. The last line shows the macro-average over languages.
Language | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS |
Arabic | 99.98 | 94.58 | 82.09 | 88.53 | 84.00 | 84.16 | 81.97 | 88.46 | 75.80 | 71.19 | 66.80 | 56.10 | 61.95 | 69.24 | 66.92 |
Bulgarian | 99.91 | 99.91 | 94.17 | 97.62 | 94.34 | 95.39 | 93.78 | 94.60 | 91.08 | 86.96 | 82.34 | 75.80 | 75.55 | 85.77 | 84.86 |
Czech | 99.88 | 99.88 | 93.18 | 97.83 | 90.88 | 90.77 | 89.71 | 97.42 | 86.24 | 81.75 | 78.07 | 67.93 | 75.84 | 79.61 | 77.21 |
Dutch | 99.74 | 99.74 | 69.26 | 92.60 | 89.88 | 92.01 | 89.00 | 94.41 | 83.37 | 79.43 | 71.92 | 61.91 | 66.42 | 77.99 | 77.37 |
English | 99.22 | 99.22 | 83.82 | 93.63 | 92.77 | 94.09 | 90.70 | 95.41 | 83.67 | 80.09 | 75.82 | 67.24 | 72.06 | 79.21 | 78.45 |
Estonian | 99.70 | 99.70 | 89.98 | 94.99 | 96.23 | 92.80 | 90.97 | 90.37 | 80.65 | 75.53 | 72.72 | 64.56 | 63.80 | 74.98 | 74.09 |
Finnish | 99.70 | 99.68 | 88.65 | 94.83 | 54.52 | 93.02 | 51.82 | 87.09 | 84.11 | 79.68 | 76.54 | 69.00 | 64.25 | 77.76 | 75.73 |
French | 99.65 | 99.23 | 94.35 | 93.51 | 99.23 | 88.82 | 87.26 | 94.94 | 87.24 | 80.61 | 72.09 | 58.25 | 66.69 | 80.07 | 77.77 |
Italian | 99.93 | 99.84 | 98.76 | 97.18 | 97.04 | 97.10 | 96.17 | 97.37 | 90.23 | 87.39 | 81.42 | 76.82 | 77.87 | 85.93 | 84.77 |
Latvian | 99.33 | 99.33 | 98.74 | 93.48 | 84.29 | 89.55 | 83.93 | 92.73 | 84.41 | 79.69 | 76.08 | 63.63 | 69.98 | 77.15 | 75.57 |
Lithuanian | 99.91 | 99.91 | 87.87 | 90.33 | 80.69 | 81.20 | 79.33 | 88.75 | 72.93 | 66.29 | 62.61 | 45.87 | 54.25 | 63.67 | 61.41 |
Polish | 99.40 | 99.83 | 97.52 | 96.43 | 84.87 | 83.62 | 80.35 | 95.60 | 88.36 | 83.38 | 79.41 | 60.08 | 74.97 | 81.39 | 74.54 |
Russian | 99.60 | 99.60 | 98.80 | 97.78 | 99.60 | 85.34 | 84.97 | 96.55 | 86.81 | 83.24 | 80.01 | 62.81 | 76.73 | 81.68 | 80.35 |
Slovak | 100.00 | 100.00 | 85.28 | 92.93 | 77.06 | 80.34 | 76.71 | 86.56 | 83.24 | 78.26 | 73.87 | 53.83 | 61.56 | 76.47 | 73.46 |
Swedish | 99.18 | 99.18 | 93.54 | 93.35 | 90.96 | 84.87 | 83.15 | 89.98 | 82.22 | 77.61 | 73.71 | 56.84 | 64.90 | 76.16 | 75.24 |
Tamil | 99.16 | 94.51 | 97.52 | 81.31 | 76.35 | 80.45 | 75.59 | 84.14 | 59.65 | 48.82 | 43.60 | 35.48 | 39.61 | 48.07 | 46.99 |
Ukrainian | 99.85 | 99.81 | 96.61 | 94.91 | 84.03 | 84.28 | 83.32 | 93.56 | 83.39 | 78.73 | 73.56 | 57.75 | 67.39 | 76.23 | 74.02 |
Average | 99.66 | 99.06 | 91.18 | 93.60 | 86.87 | 88.11 | 83.45 | 92.23 | 82.55 | 77.57 | 72.97 | 60.82 | 66.70 | 75.96 | 74.04 |
The system output for each language was split into parts corresponding to individual source treebanks. The scores then ignore errors in enhancement types for which the treebank lacks gold-standard annotation. The column LAvgELAS shows the qualitative ELAS averaged over treebanks of the same language; the final average in bold is averaged over languages rather than treebanks. For comparison, the last column then shows the coarse ELAS F1 for the given language.
Treebank | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS | Enhancements | LAvgELAS | cf. |
Arabic-PADT | 99.98 | 94.58 | 82.09 | 88.53 | 84.00 | 84.16 | 81.97 | 88.46 | 75.80 | 71.19 | 66.80 | 56.10 | 61.95 | 69.24 | 66.92 | (no xsubj) | 66.92 | 66.92 |
Bulgarian-BTB | 99.91 | 99.91 | 94.17 | 97.62 | 94.34 | 95.39 | 93.78 | 94.60 | 91.08 | 86.96 | 82.34 | 75.80 | 75.55 | 85.77 | 84.86 | 84.86 | 84.86 | |
Czech-FicTree | 99.98 | 99.93 | 89.65 | 95.71 | 73.59 | 76.55 | 69.91 | 96.34 | 86.35 | 80.92 | 76.69 | 46.60 | 72.96 | 79.23 | 76.98 | 76.69 | 77.21 | |
Czech-CAC | 99.97 | 99.96 | 93.10 | 96.98 | 89.05 | 88.63 | 87.59 | 96.27 | 87.00 | 82.69 | 78.94 | 66.50 | 75.34 | 79.52 | 76.59 | 76.69 | 77.21 | |
Czech-PDT | 99.93 | 99.93 | 93.35 | 98.22 | 92.74 | 92.42 | 91.89 | 97.83 | 86.33 | 82.00 | 78.38 | 70.20 | 76.44 | 79.81 | 77.43 | 76.69 | 77.21 | |
Czech-PUD | 99.27 | 99.27 | 95.93 | 96.51 | 90.04 | 89.39 | 88.40 | 95.32 | 84.91 | 79.69 | 75.79 | 64.96 | 72.87 | 78.05 | 75.75 | (no codepend) | 76.69 | 77.21 |
Dutch-Alpino | 99.83 | 99.83 | 88.59 | 94.11 | 91.47 | 93.31 | 90.70 | 95.11 | 87.01 | 82.82 | 76.18 | 66.40 | 70.76 | 81.57 | 80.86 | 77.45 | 77.37 | |
Dutch-LassySmall | 99.65 | 99.65 | 53.62 | 91.16 | 88.37 | 90.77 | 87.37 | 93.74 | 79.89 | 76.20 | 68.00 | 57.77 | 62.43 | 74.58 | 74.05 | 77.45 | 77.37 | |
English-EWT | 98.90 | 98.90 | 77.40 | 93.26 | 92.75 | 94.23 | 91.30 | 95.45 | 82.17 | 78.72 | 74.41 | 67.36 | 71.13 | 77.86 | 77.24 | 78.56 | 78.45 | |
English-PUD | 99.59 | 99.59 | 96.00 | 94.06 | 92.80 | 93.92 | 89.98 | 95.37 | 85.44 | 81.71 | 77.61 | 67.09 | 73.22 | 80.80 | 79.88 | 78.56 | 78.45 | |
Estonian-EDT | 99.96 | 99.96 | 91.56 | 95.61 | 96.76 | 93.41 | 91.75 | 90.58 | 81.80 | 76.91 | 74.15 | 66.29 | 64.99 | 76.74 | 75.90 | (no xsubj) | 70.78 | 74.09 |
Estonian-EWT | 98.48 | 98.48 | 80.46 | 92.03 | 93.72 | 89.88 | 87.21 | 89.34 | 75.16 | 68.96 | 65.73 | 56.15 | 58.00 | 66.81 | 65.67 | (no codepend, no xsubj) | 70.78 | 74.09 |
Finnish-TDT | 99.71 | 99.70 | 88.64 | 94.27 | 95.41 | 91.93 | 90.69 | 86.88 | 83.24 | 78.56 | 75.42 | 67.09 | 63.01 | 76.73 | 74.52 | 76.09 | 75.73 | |
Finnish-PUD | 99.67 | 99.66 | 88.66 | 95.57 | 0.00 | 94.47 | 0.00 | 87.36 | 85.26 | 81.18 | 78.01 | 71.50 | 65.87 | 79.46 | 77.67 | (no codepend, no xsubj) | 76.09 | 75.73 |
French-Sequoia | 99.79 | 99.09 | 87.50 | 96.09 | 99.09 | 94.22 | 93.31 | 96.93 | 87.89 | 84.86 | 80.07 | 71.77 | 77.78 | 83.68 | 82.40 | (no gapping, relcl, case) | 79.61 | 77.77 |
French-FQB | 99.59 | 99.30 | 95.67 | 92.44 | 99.30 | 86.56 | 84.74 | 94.11 | 86.97 | 78.84 | 68.77 | 52.62 | 62.08 | 78.40 | 76.81 | (no gapping, relcl, case) | 79.61 | 77.77 |
Italian-ISDT | 99.93 | 99.84 | 98.76 | 97.18 | 97.04 | 97.10 | 96.17 | 97.37 | 90.23 | 87.39 | 81.42 | 76.82 | 77.87 | 85.93 | 84.77 | 84.77 | 84.77 | |
Latvian-LVTB | 99.33 | 99.33 | 98.74 | 93.48 | 84.29 | 89.55 | 83.93 | 92.73 | 84.41 | 79.69 | 76.08 | 63.63 | 69.98 | 77.15 | 75.57 | 75.57 | 75.57 | |
Lithuanian-ALKSNIS | 99.91 | 99.91 | 87.87 | 90.33 | 80.69 | 81.20 | 79.33 | 88.75 | 72.93 | 66.29 | 62.61 | 45.87 | 54.25 | 63.67 | 61.41 | 61.41 | 61.41 | |
Polish-LFG | 97.66 | 99.87 | 98.25 | 96.35 | 77.84 | 70.08 | 58.92 | 95.77 | 92.36 | 87.39 | 84.06 | 46.84 | 79.32 | 85.50 | 74.67 | (no gapping) | 74.46 | 74.54 |
Polish-PDB | 99.86 | 99.84 | 97.51 | 97.07 | 88.11 | 88.37 | 87.30 | 95.94 | 87.46 | 82.44 | 78.40 | 65.17 | 74.39 | 80.48 | 74.85 | 74.46 | 74.54 | |
Polish-PUD | 99.79 | 99.77 | 96.28 | 95.31 | 83.95 | 84.58 | 82.95 | 94.87 | 87.15 | 82.23 | 78.01 | 60.12 | 73.01 | 80.24 | 73.87 | 74.46 | 74.54 | |
Russian-SynTagRus | 99.60 | 99.60 | 98.80 | 97.78 | 99.60 | 85.34 | 84.97 | 96.55 | 86.81 | 83.24 | 80.01 | 62.81 | 76.73 | 81.68 | 80.35 | 80.35 | 80.35 | |
Slovak-SNK | 100.00 | 100.00 | 85.28 | 92.93 | 77.06 | 80.34 | 76.71 | 86.56 | 83.24 | 78.26 | 73.87 | 53.83 | 61.56 | 76.47 | 73.46 | 73.46 | 73.46 | |
Swedish-Talbanken | 99.89 | 99.89 | 96.13 | 95.59 | 93.90 | 94.46 | 92.87 | 95.38 | 85.68 | 81.56 | 77.88 | 70.33 | 72.84 | 80.10 | 79.24 | 75.07 | 75.24 | |
Swedish-PUD | 98.41 | 98.41 | 90.47 | 90.94 | 87.80 | 74.58 | 72.73 | 84.19 | 78.50 | 73.38 | 69.26 | 42.41 | 56.41 | 71.90 | 70.91 | 75.07 | 75.24 | |
Tamil-TTB | 99.16 | 94.51 | 97.52 | 81.31 | 76.35 | 80.45 | 75.59 | 84.14 | 59.65 | 48.82 | 43.60 | 35.48 | 39.61 | 48.11 | 47.02 | (no gapping, xsubj, relcl) | 47.02 | 46.99 |
Ukrainian-IU | 99.85 | 99.81 | 96.61 | 94.91 | 84.03 | 84.28 | 83.32 | 93.56 | 83.39 | 78.73 | 73.56 | 57.75 | 67.39 | 76.23 | 74.02 | 74.02 | 74.02 | |
Average | 99.56 | 99.23 | 90.66 | 94.12 | 85.86 | 87.84 | 81.98 | 92.84 | 83.50 | 78.63 | 74.14 | 60.90 | 68.13 | 76.99 | 74.77 | 73.95 |